Papers with spatial localization
Visual Prompting in LLMs for Enhancing Emotion Recognition (2024.emnlp-main)
Copied to clipboard
Qixuan Zhang, Zhifeng Wang, Dylan Zhang, Wenjia Niu, Sabrina Caldwell, Tom Gedeon, Yang Liu, Zhenyue Qin
| Challenge: | Existing methods for enhancing in-context emotion classification fail to include spatial relationships between different people and facial features within a single face. |
| Approach: | They propose a set-of-vision prompting approach that uses spatial information to mark targets precisely. |
| Outcome: | The proposed approach improves face count and emotion categorization while preserving the enriched image context. |
LPO: Towards Accurate GUI Agent Interaction via Location Preference Optimization (2026.findings-acl)
Copied to clipboard
Jiaqi Tang, Yu Xia, Yi-Feng Wu, Yuwei Hu, Chen Yuhui, Qing-Guo Chen, Xiaogang Xu, Xiangyu Wu, Hao LU, Yanqing Ma, Shiyin Lu, Qifeng Chen
| Challenge: | Existing strategies for spatial localization are limited due to their limited capacity to perceive positional data. |
| Approach: | They propose a location-based approach that leverages locational data to optimize interaction preferences. |
| Outcome: | The proposed approach achieves SOTA results across offline benchmarks and real-world evaluations. |
AnchorSeg: Language Grounded Query Banks for Reasoning Segmentation (2026.acl-long)
Copied to clipboard
Rui Qian, Chuanhang Deng, Qiang Huang, Jian Xiong, Mingxuan Li, Yingbo Zhou, Wei Zhai, Jintao Chen, Dejing Dou
| Challenge: | Existing models rely on a single segmentation token whose hidden state implicitly encodes both semantic reasoning and spatial localization . Existing methods rely only on SEG>, which encodes semantic reasoning, limiting the model's ability to explicitly disentangle what to segment from where to segment. |
| Approach: | They propose a method which reformulates reasoning segmentation as a structured conditional generation process over image tokens conditioned on language grounded query banks. |
| Outcome: | The proposed model bridges token-level predictions and pixel-level supervision by decoupling spatial grounding from semantic reasoning through structured language grounded query banks. |